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^ Predictjve.stMejep.r^^^^^ 1 
Satinder Singh, Michael R. 3ames, Matthew R. Rudary 

July 2004 Proceedings of the 20th conference on Uncertainty in artificial intelligence 
AUAI '04 

Publisher: AUAI Press 

Full text available: '^i>df(.407.04.KBJ Additional Information: TuJicitatipn^ abstract, references, citings 

Modeling dynamical systems, both for control purposes and to make predictions about 
their behavior, is ubiquitous in science and engineering. Predictive state representations 
(PSRs) are a recently introduced class of models for discrete-time dynamical systems. The 
key idea behind PSRs and the closely related OOMs (Jaeger's observable operator models) 
is to represent the state of the system as a set of predictions of observable outcomes of 
experiments one can do in the system. This makes PSRs ... 



Composite sequence compaction for finite-state machines using block entropy and 
high-order Markov models 

Radu Marculescu, Diana Marculescu, Massoud Pedram 

August 1997 Proceedings of the 1997 international symposium on Low power 

electronics and design 
Publisher: ACM Press 

Full text available: ffipdf(892^59.KB) Additional Information: .feJLcitatipn^ references, citings 



3 Online Only: ACM Transactions on Design Automation of Electronic Systems. voL 1 1 . B 
issue 3 (Novel Paradigms in System-Level Design): A stimulus-free graphical 

*^ probabiiistic switching mode! for sequential circuits using dynamic bayesian networks 
Sanjukta Bhanja, Karthikeyan Lingasubramanian, N. Ranganathan 

June 2004 ACM Transactions on Design Automation of Electronic Systems (TODAES) , 
Proceedings of the 41st annual conference on Design automation DAC 

'04, Volume 11 Issue 3 
Publisher: ACM Press 

Full text available: ^.p.dg33L63 KB) Additional Information: fulJ..cMtjon, abstract references, index jernis 

We propose a novel, nonsimulative probabilistic model for switching activity in sequential 
circuits, capturing both spatio-temporal correlations at internal nodes and higher order- 
temporal correlations due to feedback. This model, which we refer to as the temporal 
dependency model (TDM), can be constructed from the logic structure and is shown to be 
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a dynamic Bayesian network. Dynamic Bayesian networks are extremely powerful in 
modeling high order temporal, as well as spatial, correlations; TDM ... 

Keywords: Dynamic Bayesian networks, TDM, sequential circuits 



4 Computation, communication, belief revision: Pianning and progrannming with first- ^ 

Qrder.markoy.decisjon 
Craig Boutilier 

July 2001 Proceedings of the 8th conference on Theoretical aspects of rationality 
and knowledge 

Publisher: Morgan Kaufmann Publishers Inc. 

Full text available: ^.adf(97a99. K3j Additional Information: Ml cMUon, abstract references 

Markov decision processes (MDPs) have become the de facto standard model for decision- 
theoretic planning problems. However, classic dynamic programming algorithms for MDPs 
[22] require explicit state and action enumeration. For example, the classical 
representation of a value function is a table or vector associating a value with each 
system state; such value functions are produced by iterating over the state space. Since 
state spaces grow exponentially with the number of domain features, the ... 

^ VjsuaiizMlon.of n B 
^ Igor Cadez, David Heckerman, Christopher Meek, Padhraic Smyth, Steven White 
^ August 2000 Proceedings of the sixth ACM SIGKDD international conference on 
Knowledge discovery and data mining 
Publisher: ACM Press 

Full text available: ^.p.df,284;M KB) Additional Information: Ml.citation, refeienceSj citin^Sj index terms 



Keywords: Internet, Web, data visualization, model-based clustering, sequence 
clustering 



^ Modeling muitipath fading channel dynamics for packet data performance analysis 
Young Yong Kim, San-ql Li 

December 2000 Wireless Networks, volume 6 issue 6 
Publisher: Kluwer Academic Publishers 

Full text available: '^ pdff268.51 KS) Additional Information: full citation, abstrgsct. references, index terms 

The muitipath fading channel modeling traditionally focuses on physical level dynamics 
such as signal strength and bit error rate. In this paper we characterize muitipath fading 
channel dynamics at the packet level and analyze the corresponding data queueing 
performance in various environments. The integration of wireless channel modeling and 
data queueing analysis provides us a unique way to capture important channel statistics 
with respect to various wireless network factors such as chann ... 

7 DXQamlc.conditionM.ra^^ 

^ Charles Sutton, KhasFiayar Rohanimanesh, Andrew McCallum 

July 2004 Proceedings of the twenty-first international conference on Machine 

learning ICML '04 
Publisher: ACM Press 

Full text available: ^ocltM69.61 K3^ Additional Information: full citation, abstract, references, citings 

In sequence modeling, we often wish to represent complex interaction between labels, 
such as when performing multiple, cascaded labeling tasks on the same sequence, or 
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when long-range dependencies exist. We present dynamic conditional random fields 
(DCRFs), a generalization of linear-chain conditional random fields (CRFs) in which each 
time slice contains a set of state variables and edges— a distributed state representation 
as in dynamic Bayesian networks (DBNs)— and parameters are tie ... 

^ Seguence.compacto 

^ Diana Marculescu, Radu Marculescu, Massoud Pedram 

^ June 1997 Proceedings of the 34th annual conference on Design automation DAC '97 
Publisher: ACM Press 

Full text available: Mpdft51,57 KB) Additional Information: fuW citation, abstract references, citing.s. index 

fS'.PyblLsheiSrte l^IIQ^ 

The objective of this paper is to provide aneffective technique for accurate modeling of 
the externalinput sequences that affect the behavior of Finite StateMachines (FSMs). The 
proposed approach relies on adaptivemodeling of binary input streams as Markov sources 
of fixed-order.The input model itself is derived through a one-passtraversal of the input 
sequence and can be used to generatean equivalent sequence, much shorter in length 
compared tothe original sequence. The compacted sequence can b ... 

9 Modeling for text compression 
S Timothy Bell, Ian H. Witten, John G. Cleary 

yr\ December 1989 ACM Computing Surveys (CSUR), Volume 21 issue 4 
Publisher: ACM Press 

Additional Information: full citiation. abstract, references, citings, index 



Full text available: ' 

tefinSa .review 

The best schemes for text compression use large models to help them predict which 
characters will come next. The actual next characters are coded with respect to the 
prediction, resulting in compression of information. Models are best formed adaptively, 
based on the text seen so far. This paper surveys successful strategies for adaptive 
modeling that are suitable for use in practical text compression systems. The strategies 
fall into three main classes: finite-context modeling, i ... 

^0 An integrated mobility and traffic model for resource aliocation in wireless networks 
1^ Hisashi Kobayashi, Shun-Zheng Yu, Brian L. Mark 

^ August 2000 Proceedings of the 3rd ACM international workshop on Wireless mobile 
multimedia 
Publisher: ACM Press 

Full text available- m pdfi943 60 KB) Additional Information: M cilation, abstr^ reMrences, citiim Index 

^ terms 

In a wireless comnnunications network, the movement of mobile users presents significant 
technical challenges to providing efficient access to the wired broadband network. In this 
paper, we construct a new analytical/numerical model that characterizes mobile user 
behavior and the resultant traffic patterns. The model is based on a semi-Markov process 
representation of mobile user behavior in a general state-space. Using a new algorithm 
for parameter estimation of a general Hidden Semi-Markov ... 

Keywords: admission control, mobility, resource aliocation, traffic modeling, wireless 
networks 



^1 Web search and navigation: Reiattonal Markov mode^^^^^^ 
]^ adaptive web navigation 

^ Corin R. Anderson, Pedro Domingos, Daniel S. Weld 

July 2002 Proceedings of the eighth ACM SIGKDD international conference on 
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Knowledge discovery and data mining 

Publisher: ACM Press 

(- II A ^ -.1-1 A% ^£JM A-7 yA-^^ Additional Information: full citation, abstract, references, citings, index 

Full text available: ^ pdf(1.17 MB) : ' ' — ' ^ 

^ terms 

Relational Markov models (RMMs) are a generalization of Markov models where states can 
be of different types, with each type described by a different set of variables. The domain 
of each variable can be hierarchically structured, and shrinkage is carried out over the 
cross product of these hierarchies. RMMs make effective learning possible in domains with 
very large and heterogeneous state spaces, given only sparse data. We apply them to 
modeling the behavior of web site users, improving predict ... 

Keywords: Markov models, Web mining, personalization, relational probabilistic models, 
shrinkage 



Hierarchical sequence compaction for power estimation 
Radu Marculescu, Diana Marculescu, Massoud Pedram 
^Sr: June 1997 Proceedings of the 34th annual conference on Design automation DAC '97 
Publisher: ACM Press 

Full text available: J pdt(103 29 KB) Additional Information: full citation, abstract, references. cILinQS. index 

® Put3iisher Site fenn^ 

This paper presents an effective technique forcompacting a large sequence of input 
vectors into a muchsmaller one such that when the two sequences are applied toany 
circuit, the resulting power dissipations are nearly thesame. Specifically, this paper 
introduces the hierarchicalmodeling of Markov chains as a flexible framework forcapturing 
not only complex spatiotemporal correlations, butalso dynamic changes in the 
characteristics of the inputsequence. The new framework has a high degree ofadapt ... 

13 Trace-driven steady-state probability estimation in FSMs with applfcation to power 
eMImMion 

D. Marculescu, R. Marculescu, M. Pedram 

February 1998 Proceedings of the conference on Design, automation and test in 
Europe 

Publisher: IEEE Computer Society 

Full text available: 'gMft69,96„l<B) Additional Information: Ml cMlon, abstract, references, citings, index 
'P.PublisherMe 

This paper illustrates, analytically and quantitatively, the effect of high-order temporal 
correlations on steady-state and transition probabilities in finite state machines (FSMs). 
As the main theoretical contribution, we extend the previous work done on steady-state 
probability calculation in FSMs to account for complex spatiotemporal correlations which 
are present at the primary inputs when the target machine models real hardware and 
receives data from real applications. More precisely: 1) us ... 

Keywords: Probabilistic FSM analysis, high-order Markov chains, power estimation 



14 Risk analysis: derivatives pricing and risk-sensitive estimation: Risk and information Q 
in.the eMmation„of„hi^ 

Vahid R. Ramezani, Steven I. Marcus, Michael Fu 

December 2004 Proceedings of the 36th conference on Winter simulation WSC '04 
Publisher: Winter Simulation Conference 

Full text available: "Mpdl29ZJ3.KB) Additional Information: MLcitatipn. abstract, refeieQpes 



http://portal.acm.org/resultsxfm?coll=ACM&dl==ACM&CFro=2576340&CFTOKEN=47994 



10/19/06 



Results (page 1): dynamic order markov model 



Page 5 of 6 



In this paper, we consider the relationship between risk-sensitivity and information. 
Product estimators are introduced as a generalization of Maximum A Posteriori Probability 
(MAP) estimator for Hidden Markov Models. We study the relationship between the 
inclusion of higher order moments, the underlying dynamics and the availability of 
information. Asymptotic periodicity of these estimators and the relationship between risk 
and information is studied via simulation. 

* BeQQveryJjm e„ of ..c^^^^ 
Artur Czumaj 

^ June 1998 Proceedings of the tenth annual ACM symposium on Parallel algorithms 
and architectures 
Publisher: ACM Press 

Full text available: ^odtM.38 MB) Additional Information: full cjtiation. references, citings, index terms 



An inter-reference gap mode! for temporal locality in program behavior 
^ VIdyadhar Phalke, Bhasicarpillai Gopinath 

iSr: May 1995 ACM SIGMETRXCS Performance Evaluation Review , Proceedings of the 
1995 ACM SIGMETRICS joint international conference on Measurement 
and modeling of computer systems SIGMETRICS '95/ PERFORMANCE '95, 

Volume 23 Issue 1 

Publisher: ACM Press 

Full text available- ^od^M.l6 MB) Additional Information: fijidtatlpn, abstract, references^ citings, index 
^ " terms 

The property of locality in program behavior has been studied and modelled extensively 
because of its application to memory design, code optimization, multiprogramming etc. 
We propose a k order Markov chain based scheme to model the sequence of time 
intervals between successive references to the same address in memory during program 
execution. Each unique address in a program is modelled separately. To validate our 
model, which we call the Inter-Reference Gap (IRG) model, we show substant ... 

Keywords: Markov chains, dynamic memory management, locality of reference, memory 
replacement, prediction, trace compaction, trace driven simulation 



An.anaJysiS.of.the„i^^^^^ 
]^ Jeffrey C. Becker, Arvin Park, Matthew Farrens 

^ September 1991 Proceedings of the 24th annual international symposium on 
Microarchitecture 
Publisher: ACM Press 

Full text available: ^.p.df(61 8,07 K3) Additional Information: Ml cjtatjon, references, dtln^s^ index terms 
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Dani Goldberg, Maja 3, Matarid 
^ April 1999 Proceedings of the third annual conference on Autonomous Agents 

Publisher: ACM Press 

Full text available: ^ j.dgl,OO.MB) Additional Information: M[ cjtatlQn, Merences^ citin^s^ iMex terms 



19 Modeling methodology B: modeling call centers: Approximate dynamic programming 

in multi-skiii call centers 
Ger Koole, Auke Pot 
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December 2005 Proceedings of the 37th conference on Winter simulation WSC '05 
Publisher: Winter Simulation Conference 

Full text available: ■^pdftl66,46„KB) Additional Information: MLcitatipn, abstract references 

We consider a multi-skill call center consisting of specialists and fully cross-trained 
agents. All traffic is inbound and there is a waiting queue for each skill type. Our objective 
is to obtain good call routing policies. In this paper we use the so-called policy iteration 
(PI) method. It is applied in the context of approximate dynamic programming (ADP). The 
standard PI method requires the exact value function, which is well known from dynamic 
programming. We remark that standard methods to o ... 



20 Throughput of selective-repeat ARQ with time diversity in Markov channels with 

unreliable feedback 

Michele Zorzi, Ramesh R. Rao 

March 1996 Wireless Networks, volume 2 issue i 

Publisher: Kluwer Academic Publishers 

Full text available- "Pj pdfM.ie MBl Additional Information: ^Mll citation , ^bstmct. leMrences. ciiiim lOdeK 
^''^^^ terms 

In this paper, a modified form of the ARQ selective repeat protocol with timer control is 
studied. Transmissions on both the forward and the reverse channels are assumed to 
experience Markovian errors and therefore the feedback is unreliable. Feedback error 
recovery is made possible through the use of time diversity. Using results from renewal 
theory, exact results for the throughput of the protocol are evaluated. In order to 
overcome the complexity of the exact analytical technique, lower a ... 
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